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PORTABLE HAND-HELD MUSIC SYNTHESIZER METHOD AND APPARATUS 

BACKGROUND OF THE INVENTION 

The invention relates generally to portable digital audio play-out devices. More 
particularly, it concerns the provision of high-quality, high- volume digital audio file 
format compatible with downloading music to a portable hand-hand held device. 

Portable MP3 players such as the Intel PocketConcert™ player provide a 
convenient way to transport music while traveling. However, even the best-known 
methods of audio compression, e.g. MP3, still produce extremely large files. For 
example, an hour of music compressed to 128 kilobits/sec (kbps) with MP3 occupies 
approximately 64 megabytes (MB) of memory. Such a large memory requirement 
limits range of access to portable music and for many is prohibitively expensive. 

PCM audio, e.g. audio CDs or WAV files, are created by sampling a continuous 
audio signal and recording the amplitude in digital form. Those of skill in the art will 
appreciate that such a recording format is very data intensive and requires very high- 
bandwidth (e.g. 1.2 megabits/second (1.2 Mbps) data input/output (I/O) and data 
processing pathways and proportionately very high-capacity memory storage. 

Conventional portable MP3 or Windows Media players and music synthesizer 
programs on desktop personal computers (PCs) transform time-domain PCM signals 
into frequency-domain audio data and then compress the data to eliminate inaudible 
frequency ranges. Such compressed-audio data files nevertheless require high- 
bandwidth processing (e.g. 128kbps) and proportionately high-capacity memory 
storage. With desktop PCs, such large memory requirements are more easily met than 
with hand-held portable or pocket devices such as personal digital assistants (PDAs) or 
so-called pocket PCs. Those of skill in the art will appreciate that, the larger the 
memory, the more substantial the power requirement. Thus, large memories required to 
store even compressed, e.g. MP3, high-fidelity music-representative data in hand-held 
portable devices, also decrease useful battery life, which remains at a premium despite 
continuous developments in battery technology. 
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The musical instrument digital interface (MIDI), an existing music industry 
standard, is a common interface option on many desktop PCs. It provides a coding 
standard for synthesizing and recording musical events, e.g. note on, note off, attack, 
delay, pan, etc. Familiarity by those of skill in the art with the MIDI standard is 
assumed. Generally, the MIDI format is considered a compressed format because it 
does not require synthesis or storage of each and every nuance of continuous voice, 
pitch, duration, volume and envelope quality of a musical note, beat, phrase, score or 
lyric. Essentially, it is represents a computerized version, or coded, musical score that 
defines only musical events and their sequence, thereby significantly reducing the 
overhead of such detailed, high-bandwidth audio sampling and recording techniques. 
Typically, a MIDI file requires only approximately 12kbps in bandwidth and 
proportionately smaller memory storage capacity. 

Accordingly, wider access to music synthesis in a convenient, portable format 
combined with compressed audio playback capability is desired. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a system block diagram of the invented pocket music synthesizer in 

accordance with an embodiment of the invention, connected to a conventional desktop 

personal computer (PC). 

Fig. 2 is a detailed schematic diagram of the pocket music synthesizer of Fig. 1 . 
Fig. 3 is a flowchart illustrating the invented method in accordance with an 

embodiment thereof 

DETAILED DESCRIPTION 
Those of skill in the art will appreciate that an MP3 or other compressed audio file 
typically stores multiple digitized waveform patterns at a given high resolution, the 
patterns representing continuous and continuously changing musical characteristics as 
pitch, volume, envelope duration, attack, decay, etc. Such files are high-resolution digital 
representations of actual sounds, and, as such, may be understood to require high- volume 
storage and high-bandwidth signal processing. Audio players using such audio file 
formats thus are characterized by greater physical size, power draw and cost and lower 
capacity and thus versatility. 
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Those of skill in the art will appreciate that a MIDI file stores only a sequence of 
coded musical events (notes, volumes, rhythm patterns) needed to create the piece. A 
MIDI score therefore occupies orders of magnitude (e.g. presently nearly two orders of 
magnitude) less space than even compressed audio. A 128 MB portable hand-held music 
5 synthesizer could hypothetically hold 1 00 hours or more of MIDI music. Intermixing 
MIDI tracks with MP3 tracks would give effective playing time somewhere between two 
hours (MP3 only) and 100 hours (MIDI only), depending upon the mix of formats. Those 
of skill in the art will appreciate that this mix may be user-selectable, thereby further 
personalizing use of the invented apparatus. 

1 0 The present invention allows a user to create and arrange MIDI files on a desktop 

PC, and to download them and play them on a portable device. One embodiment of such 
a system would include one or more of the following features: 

a) a portable, battery-powered audio player device with an on-board reduced 
instruction set computer (RISC) processor or digital signal processor (DSP); 

15 b) a re-writable storage, e.g. flash memory, microdrive, mini-optical disc. etc. for 

storing MIDI files in the device; 

c) a method for downloading files to the device from a desktop PC, whether wired 
(Universal Serial Bus (USB), FireWire) or wireless (Bluetooth, ITTC 802.1 1); 

d) on-device MIDI synthesizer software with fixed or rewritable instrument banks; 
20 e) front-panel video-game type hand controls on the device facilitating user 

selection of musical volume and track selection (i.e. operational modes) elements of 
music synthesis during playback, e.g. tempo, expressiveness, looping, "funk," etc. (i.e. 
musical modes); 

f) software in the PC for creating, editing, and downloading MIDI scores and 
25 voices to the device; and 

g) an ability also to play back MP3 or other compressed audio formats on the 
portable device and to intermix compressed audio files with MIDI files on playlists. 

Fig. 1 shows the invented apparatus 10 in accordance with one aspect of the 
invention, in system block diagram form, operatively connected, e.g. via a wireless 
30 communication mechanism, with a conventional desktop personal computer (PC) 12. 
Apparatus 10 will be understood to be lightweight and portable, e.g. hand-held, and to 
include a housing 14, a thumbpad 16, a keypad 18, a display 20 and a stereo headphone 
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jack 22. Thumbpad 16 and keypad 18 will be referred to herein as front panel controls, or 
simply, user controls. 

User controls 16, 18 may include any customized key cluster, including game pad- 
like controls such as finger- and/or thumb-actuated fire buttons, hat switches and 
5 traditional keypads. As is known, hat switches may be analogue in nature, e.g. they may 
be pressure-sensitive and highly responsive to user inputs. Such switches may be used for 
expression, pace and/or volume control. Thus, a user of apparatus 10 may enjoy ease and 
precision of control of musical sources to be played out, as well as of browsing and 
selection of musical albums and/or tracks. 
1 0 Those of skill in the art familiar with pocket PCs will appreciate that housing 1 4 

contains electronics to be described that permit user key entry via the front panel controls 
'tt and feedback via display 20, which, for example, may display the current musical 

2 selection, as illustrated. Those of skill also will appreciate that the musical selection may 

K be rendered audible to the user of apparatus 1 0 by use of a speaker or stereo headphone 

?? 15 (not shown). Finally, those of skill will appreciate that musical selections may be 
\j downloaded from remote PC 12 into a memory within apparatus 1 0 on demand by the 

L user, with PC 12 having been used to create what will be referred to herein as coded audio 

•y m event data. 

s] Fig. 2 shows apparatus 10 in simplified schematic block diagram form. Apparatus 

.7 J 20 1 0 within housing 1 4 may be seen to include externally accessible and visible front panel 
controls (thumbpad 16 and keypad 1 8), display 20 and headphone jack 22. The other 
blocks within apparatus 10 include a digital microprocessor, e.g. a RISC processor or 
digital signal processor (DSP) 24; a read-only memory (ROM) 26; a random-access 
memory (RAM) 28; a high-speed, high-capacity non-volatile memory (e.g. a flash 
25 memory, a micro-drive or mini-optical disk) 30; a software program 32 adapted to 

synthesizing an analogue audio signal by converting or decoding the coded audio event 
data; a file download input/output (I/O) port 34; and a battery 36. 

Those of skill in the art will appreciate that the processor, memory and/or 
conversion functions may be differently configured, within the spirit and scope of the 
30 invention. Those of skill also will appreciate that the hand-held device and its display and 
control functions may also be differently configured, within the spirit and scope of the 
invention. The software and firmware functions and the user interface itself 
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straightforwardly may be implemented using known development tools, operating 
systems and applications programs. 

Fig. 3 illustrates the invented method of the invention in the form of a simplified 
flowchart. At 300, audio event data is created and transmitted to a hand-held device. At 
5 302, the event data is stored in a memory of the portable hand-held device. (It will be 
appreciated that, typically, the event data is downloaded, e.g. from a remote PC or other 
processor, to the hand-held device. Such may be accomplished by any suitable means, 
e.g. via infrared, radio-frequency (RF) transmission or other wireless means such as 
Bluetooth, ITTC 802.1 1, etc., or via a wired interface such as USB, Fire Wire, etc.) At 
1 0 304, the event data is read from the memory. At 306, the event data is processed to 

produce an audio signal. Finally, at 308, the audio signal is audibly outplayed from the 
portable hand-held device. It will be appreciated by those of skill in the art that the 
Q process blocks are performed or assisted by software or firmware executing in a 

K microprocessor or DSP or external PC or other external processor. For example, 

% 1 5 processing block 306 may be performed by software program 32 (see Fig. 2) stored as a 
H series of instructions residing in RAM 28 and executing in RISC processor/DSP 24. 

One drawback to synthesis is that, while current methods of music synthesis are 

|H capable of recreating instrumental sounds with excellent musical quality, they are not yet 

i y 

%J capable of synthesizing broadband vocals with high musical quality. Nevertheless, 

tl 20 prospective buyers of the invented device might be older and more interested in personal 
expression and music creation than are typical purchasers of MP3. And of course 
advances in the capabilities of formatting, storing, retrieving, converting and playing out 
coded audio event data are expected to improve, as MIDI and alternative formats are 
further developed. 

25 The portable hand-held music synthesizer apparatus would extend a supplier's 

audio product line by adding a high-tech capability not found in conventional MP3 
players. It is a natural extension to desktop PC applications software, since scoring, 
arranging and editing MIDI music require a desktop PC. Such a desktop PC may include 
an installed base of music programs, e.g. SonicFoundry Acid™, which lets a user create 

30 professional-sounding MIDI files. The invention makes it possible conveniently and 
inexpensively to transport anywhere a large personal musical library. 
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Finally, those of skill in the art will appreciate that the invented method and 
apparatus described and illustrated herein may be implemented in software, firmware or 
hardware, or any suitable combination thereof. Preferably, the method and apparatus 
are implemented in a combination of the three, for purposes of low cost and flexibility. 
Thus, those of skill in the art will appreciate that the method and apparatus of the 
invention may be implemented by a computer or microprocessor process in which 
instructions are executed, the instructions being stored for execution on a computer- 
readable medium and being executed by any suitable instruction processor. Alternative 
embodiments are contemplated, however, and are within the spirit and scope of the 
invention. 

Having described and illustrated the principles of the invention in a preferred 
embodiment thereof, it should be apparent that the invention can be modified in 
arrangement and detail without departing from such principles. I claim all modifications 
and variation coming within the spirit and scope of the following claims. 
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